Skip to content

[Zentorch] Benchmarks and CI#130

Open
IlyasMoutawwakil wants to merge 1 commit intomainfrom
zentorch-benchmarks-ci
Open

[Zentorch] Benchmarks and CI#130
IlyasMoutawwakil wants to merge 1 commit intomainfrom
zentorch-benchmarks-ci

Conversation

@IlyasMoutawwakil
Copy link
Copy Markdown
Member

@IlyasMoutawwakil IlyasMoutawwakil commented Apr 12, 2024

Adding benchmarks for zentorch backend and a ci that runs them and pushes results to optimum-amd/zentorch-benchmarks

  • common models
  • image diffusion pipelines
  • text generation models with static cache

Needs a write token with optimum-amd org write access @mfuntowicz @fxmarty

@IlyasMoutawwakil
Copy link
Copy Markdown
Member Author

IlyasMoutawwakil commented Apr 12, 2024

I suggest we create a bot account that has write access to the optimum-amd hf organization.
I did that for optimum-benchmark to test the hub integration:

The only problem is that it also needs to request access for every gated models.
The best option (which I just found out about) is using a fine-grained token with write access to optimum-amd org.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant